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Abstract 

This note introduces a new notion of random dynamical system with inputs and outputs, and sketches 
a small-gain theorem for monotone systems which generalizes a similar theorem known for deterministic 
systems. 



1 Introduction 

Monotone systems, whose mathematical development was pioneered by Hirsch [Qj I10| and Smith \12\ lllj , 
play a key role in many application areas, and particularly in the modeling and analysis of biological 
systems. They constitute a class of dynamical systems for which a rich theory exists, endowing them 
with very robust dynamical characteristics. In order to analyze interconnections of monotone systems, 
however, it is necessary to extend the notion and introduce the concept of monotone systems with inputs 
and outputs, as standard in control theory |13] . so as to incorporate input and output channels. This was 
done in [T] , which also presented a result that guarantees stability of monotone systems under negative 
feedback (so that the closed-loop system is no longer monotone); this result may be viewed as a "small 
gain theorem" in terms of an appropriate notion of system gain. 

An interesting question is: to what extent do results for monotone I/O systems extend to the analysis 
of systems subject to stochastic uncertainty or random inputs? This paper proposes an approach based 
upon the notion of "random dynamical system" (RDS) due to Arnold [2], and more specifically the 
subclass of monotone RDS studied in [J]. Even more than when passing from deterministic monotone 
systems to monotone systems with inputs and outputs, the generalization is not entirely straightforward, 
and many subtle mathematical and conceptual details have to be worked out. We introduce the necessary 
formalism in this note (in a more general context of not necessarily monotone systems) and sketch an 
analogue of the small gain theorem proved in [1]. 



2 Random Dynamical Systems 

We start by reviewing, with some added concepts and slight changes of notations, the formalism of 
RDS's introduced by L. Arnold. 
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2.1 Basic Definitions 



Wc suppose given a Borel subset X of a separable Banach space V, constituting the measurable space 
{X,B) when equipped with the tr-algebra B of Borel subsets of X. We also suppose given a measure 
preserving dynamical systerr^ 6 = (fl, P, {6t}t<£T)] that is, a probability space ($7, J^, P) together with 
a flow 6 : T X ^ H, satisfying 

(Tl) 6t := 9{t, ■) : ^ is J^-measurable for each t ^ T, 
(T2) Ot^s ~ Ot ° Os for every t,s (semigroup property), 
(T3) P o 6*4 = P for each t (measure preserving. 

As usual, T refers to either M or Z depending on whether one is talking about continuous or discrete 
time, respectively. In either case 7+ refers to the nonnegative elements of T. We note the abuse of 
notation in using the same symbol to denote both the measure preserving dynamical system, as well 
as its constituting measure preserving flow. This will be very unlikely to cause any confusion. When 
T = Z, that is, in discrete time, it follows from (T2) that is completely determined by 0i = 9{1, •) and 
so we shall use 9 to denote 0i as well. 

A (continuous) random dynamical system (RDS) ip with state space X, over is a measurable map 
ip : T+ X fl X X ^ X such that 

(51) Lp{t, u) := Lp{t, uj,-) : X ^ X is continuous for each i G 7+, w g 

(52) Lp{0, w) = idx for each w G fi, and 

(p{t + s, w) ~ (p{t, 6'sCj) o ip(s, uj) 
for each s,t £ T+, uj e il (cocycle property). 

Notice that RDSs include deterministic dynamical systems as the special case in which f2 is a singleton. 
The cocycle property generalizes the semigroup property of deterministic dynamical systems. 

Here the analogue to points in the state space X for a deterministic system are random variables O — > X, 
that is, 6-measurable maps — ?> X. We denote the set of all such maps by X^. We say that a map 
q : Tjjo X n — >■ X is a 0-stochastic process on X, or simply a random trajectory, if q{t, •) G X^ for each 

Given G , we define the trajectory starting at to be the map ^ : 7+ x O — >• A which is defined by 

^(t,w) :=^(t,w,^o(w)), {t,iu)eT^oxn. (1) 

Recall from [4j Definition 1.7.1 on page 38] that an equilibrium of an RDS is by definition a random 
variable ^ : H ^ X such that 

ip{t,UJ,^{Lj))=^{0tu) 

for all t G 7^0, G fi. 

The remaining of this section is devoted to interpreting the concept of equilibrium for an RDS in terms 
of a shift operator in the set Sg- of all 0-stochastic processes on X. For each s G T^o let 

q ^ Ps{q) 



^Some authors [3] Definition 1.1.1 on page 10], O page 635] refer to such an object primarily as a metric dynamical 
system. We find measure preserving, which [2] also uses as a synonym, less confusing and more informative. 
^ Property (T3) is normally stated as 

P(6»~^(B)) = P(B) , \/BeT,\/teT. 
But since it follows from (T2) that 9t is invertiblc with 6^^ = 6—t for each t G T, the two formulations are equivalent. 
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be defined by 

ips{q)){t,Lu) ■.^q{t + s,0^suj), G r^o X n. (3) 

Definition 2.1 A 0-stochastic process q is said to be 9-constant if 

Ps{q) = q 

for all s £ 7^0- ^ 

Lemma 2.2 The 6'-stocliastic process q is 6'-constant if and only if there exists a random variable 
q : VI ^ X such that 

q{t, Lu) = qiOtUj) , Vt e r^o , Vw e . (4) 

Proof. (Sufficiency.) Suppose that q{t,uj) = q{9tio) for all i,cj, for some q G X^. Pick any s £ T^-o- For 
any t,uj, 

{ps{q)){t,uj) = g(t + s, fl-sw) = q{0t+sO-sU}) = q(0tuj) = w) , 

and thus Ps{q) ~ q- 

(Necessity.) Suppose that ps{q) — q for all s, and define q : il ^ X hy 

q{uj) := (7(0, w) 

for each w. The equality /^^(q) = q means that {ps{q)){t,uj) = q{t,Lu) for all s,t,uj. Using the definition 
of p, that is, {ps{q)){t,u!) = q(t + s, 9-sUj), this translates into: 

q{t + s,6^si^) = q{t,uj) 

for all s,t,io. In particular, applied with t = 0, and renaming "s" as we have that 

q{t,d_ti^) = (7(0, cj) = q{w) 

for all t G 73>o and all w G 17. Given any a; G and any t G Tjjo, wc may apply this property with 
LU ~ OtLo, obtaining 

q{t,uj) = qiOtUj) , 

which is what we wanted to prove. I 

Note that the random variable q associated to q is unique, since it has to satisfy Equation (j4)), and 
therefore is determined by q{uj) = q{0,u!). Thus, we have: 

Corollary 2.3 For any RDS and any random state G the following two properties are equivalent: 

1. ^, as defined in ([!]), is a 0-constant trajectory; 

2. ^ := ^0 is an equilibrium. 

We will always use an ovcrbar to denote the random variable q associated to a given 0-constant process 

q- 
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2.2 Convergence 



We work with the notion of "puU-back convergence" developed in the Hterature and canonized in the 
works of Arnold and Chueshov [2 14] . 



Definition 2.4 (PuU-Back Convergence) A 6'-stochastic process ^ : 7^o x 17 — ^ X is said to converge to 
a random variable & pull-back sense if 

^(t, 9-tuj) — > S.oi'^) as i — 7- GO , for almost all w S 17 . 



The reasons for pursuing convergence in the pull-back sense are historical. It has been shown to be more 
fruitful than the perhaps more intuitive convergence of the forward trajectories t ^ $^(t,Lo). The two 
modes of convergence are not equivalent, as illustrated by Examples 12.51 and 12.61 below. 



Example 2.5 Convergence in the pull-back sense does not imply convergence in the forward sense. 
Consider the measure preserving dynamical system 9 = ($7, P, {0f }^^^) where fl := { — 1, 1}, J- is the 
CT-algebra of all subsets of ft, P is the uniform probability defined by P({ — 1}) = P({1}) = 1/2, and 9 is 
the measure preserving dynamical system generated by 

9:n — > n 

Then 

6l„(w) w === -1,1, Vn e Z. 

Let X := { — 1,1} also, and consider the random variable 

s^Q-.n — > n 

UJ I J- UJ 

and the trajectory 

"{n,uj) I — > (-l)"w ■ 
Then ^ converges to in the pull-back sense: 

9^nUj) = i-l)"9^nH = i-lfcj =LU, w = -1, 1 . 

However ^ clearly does not converge in the forward sense. 



This example is assumedly trivial and artificial but illustrates the point. A similar construction yields 
a counterexample to the hypothesis that convergence in the forward sense implies convergence in the 
pull-back sense. 



Example 2.6 Convergence in the forward sense does not imply convergence in the pull-back sense. 
Consider the same measure preserving dynamical system 9 = (O, J", P, {0(}tgz), state space X and 
random variable as in the previous example. The trajectory 

^:Z^oxl7 — > n 
{n,io) ! — >■ Lu 

converges to in the forward sense, but not in the pull-back sense: 

9^r.i0) = 9^„{UJ) = i-iy'LO , L0 = -1,1. 
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Proposition 2.7 Let (p : %o x n x X X he an RDS over an MPDS 9 = {9t)teT), evolving 

on a metric space X. Suppose tlrcre exists a random initial state xq g -^b{x) ^^'^^ that almost all the 
pull-back trajectories of ip starting at xq converge to some map x : X; that is, 

ip{t,6^tUj,XQ{d^t'-^)) — > x{lu) as t — !■ oo , G 51 . (5) 

Then x is an equilibrium. 

Proof. For each t G Tjjo, the map uj ^ ip{t,6^t'-^,xo{0^t^)), w G fi, is measurable, since it's the 
composition of measurable maps: 

UJ n- 9^t^ I—!- XQ{9^t^) , 

(6'_ta;,a;o(6'_ta;)) i-^ ip{t,9^t^,xo{9^ti^)) . 

So it follows from Lemma lA. II that x is measurable. (If T is continuous time, just pick a subsequence 
{tn)neN going to infinity.) 

In addition, for each a; G such that the limit in ([SJ exists, and each r G Tjjo, we have 



also. Hence 



lim ip{t - T, 9r-tOL!, xo{9r-t^)) = x{uj) 



x(9rUi) = lim iy9(t, 6'_j6't-w, a;o(0_t07.a;)) 

t— >-oo 



lim ip{t - T + T, 9r-ti^, Xo{9r-ti^)) 
i— )-oo 

lim (^(r, 6't_^+^_ta;, (^(t - t, 6*^-4^, a-o(6l^-tw))) 

i— >-oo 



= ip{T,UJ,x{uj)) 

by continuity. 



2.3 Discrete Time RDS's 

When 7" = Z we refer to (/? as a discrete random dynamical system, or a discrete RDS for short. These 
constitute a significantly simpler special case. For instance, the whole dynamics ip can be inductively 
recovered from its transition mapping 

f -Mx X — > X 

{uj,x) I — > ip{l,uj,x) 

(plus of course the underlying measure preserving dynamical system 9). What we mean by this is that 
/ is measurable, f {uj, ■): X X is continuous for each cj G il, and 

ip{0,uj,x) — X , {uj,x)£nxX, (6) 

ip{l,u},x) = fiu},x) , {uj,x)£nxX, (7) 

ip{n + l,uj,x) = f{9nU},'pin,uj,x)) , {n,u}, x) £ N x il x X) . (8) 

Conversely, ii f : il x X X is measurable and f{uj,-):X^Xis continuous for each G fi, then 
equations (j6])-(|8]) define a discrete RDS. We shall get back to this in more detail in Subsection l3.3l There 
we will discuss generators of random discrete dynamical systems with inputs, which include generators 
of discrete RDSs as a special case. 



2.4 Continuous Time RDS's 

An entirely analogous method allows one to define RDS's generated by random differential equations. 
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3 Random Dynamical Systems with Inputs and Outputs 



Wc now define a new concept that extends the notion of RDS to systems in which there is an external 
input or forcing function which is itself a stochastic process. A contribution of this work is the precise 
formulation of this concept, particularly the way in which the stochastic argument of the input is shifted 
in the semigroup (cocycle) property. Note that stochasticity of inputs is essential if one is to develop a 
theory of interconnected subsystems, as an input to one system in such an interconnection is typically 
obtained by using a combination of outputs (necessarily random) of other subsystems. 

As in the previous section, given a metric space U we equip it with its Borel cr-algebra B(U) and denote by 
the set of Borcl measurable maps ^ U, and by the set of all random trajectories T+ xfl ^ U. 

Definition 3.1 A random dynamical system with inputs (RDSI) is a pair {9, ip) consisting of a measure 
preserving dynamical system = (fi, J-", P, {dt}teT) ^^id map 

satisfying 

(11) ip{ - u) : T+ X n X X —i- X is measurable for each u € Sg' ; 

(12) (f{t, w, ■, u) : AT — > AT is continuous, for each (i, cj, u) G 7+ x x ; 

(13) (p{0, oj, x,u) = X for each (w, x,u) ^ fl x X x Sg' ; 

(14) given s, t G T^q, w G fJ, x G A, u, u G , suppose 

if{s,uj,x,u) = y 

and 

(p{t,esUJ,y,v) = z. 

Then 

ip(t + S, W, X, Ui) = z , 

where w : T+ x U ^ U is defined by 

, ^ f u(t,u}) , Q^T<S ^ „ 

[ t;(r - s,6'sa;) , s ^ r 

(15) given t G 7^o, w G fi, x G A, and u,v ^ Sjj^ , if Ut(w) = Vr{oj) for almost all t G [0,t), then 

ip{t,U!,X,u) = ip{t,U!,X,v). 

We refer to the elements u G , that is, the 6'-stochastic processes (or random trajectories) on U 
as inputs. Whenever we talk about a RDSI we tacitally assume the notation laid down above, unless 
otherwise specified. □ 

Remark 3.2 0. (I1)-(I2) are regularity conditions. (13) means that nothing has happened if one is still 
at time t = 0. (14) generalizes the cocycle property and (15) states that the evolution of an RDS is, so 
to speak, independent of irrelevant random states. 

1. Notice that for each s, t G T^o, x G A, w G il, 

ip{t + s,oj,x,u) = tp{t,9sUJ,ip{s,uj,x,u), ps{u)) 

for all u G Sj^ . This follows by (14) with v = Ps{u), which then renders w = u. 

2. If u, u G are such that u{-,uj) | — u(-, w) | almost surely for each w G il, then 

lp{t, UJ, X, u) = ip{T, UJ, X, u) 

for each t G [0, i], cj G H, .t G A. This follows straight from (15). 
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Recalling the definitions stated in Equations ©-([S]), 



{ps{u)){t,0suj) = u(t + s, Loa- 
the right-hand side is the input as interpreted by an observer of the RDSI ip who started at time ti = 0, 
while the left-hand side is how someone who started observing the system at time t2 ~ s would describe 
it at time t [-\- t2). Following this interpretation, a 0-constant input would then be an input which is 
observed to be just the same, regardless of when one started observing it. 

Definition 3.3 A random dynamical system with inputs and outputs (RDSIO) is a triple (0, Lp, h), such 
that [9, If) is an RDSI, and 

h-.VlxX 

is such that h{-, x) G for each x ^ X . □ 

The concepts of RDSI and RDSIO subsume that of RDS, since one may view an RDSI as a special case 
in which U consists of just one point. The notion of trajectory extends naturally: 

Definition 3.4 Given any RDSI, any random state G and any input u £ , the 0-stochastic 
process : 7^o x — > X defined by 

(,u{t,uj) := (p{t,uj,^o{uj),u) , t eT+, uj €n, 

will be called the trajectory corresponding to the initial random state and input u. For an RDSIO, 
the 0-stochastic process r/„ : 7^o x £7 — > 1/ defined by 

riu{t, io) := h{0tuj, ip{t, ^o(w), w)) , t e T+ , uj e , 

will be called the output (trajectory) corresponding to the initial random state o,iT-d input u. □ 

Note that one can also write 

riu(t,uj) := h{OtUJ,£.u{t,oj)) ■ 
3.1 RDSI's for constant inputs are RDS's 

Denote the subset of consisting of 0-constant inputs by . Let {6, ip) be a RDSI, and suppose that 
u £ is some ^-constant input. We consider the map 

<Pti : 7^0 X fl X X ^ X : (i, w, x) i— > (p{t, uj, x, u) . 
Lemma 3.5 The pair (6*, ipu) is an RDS. 

Proof. It follows from condition (II) that Lpu is measurable and from (13) that i^„(0, w, •) = idx for every 
w G r2, so it remains to prove that ipu satisfies the cocycle property. Indeed, 

ipu{t + S,UJ,x) = ip{t + S,LO,X,u) 

= ip{t,0sUJ,ip{s,UJ,X,u),Ps{u)) 

= ip{t,0sUJ,iPuis,UJ,x),u) 

= ipuit,0sUJ,(puis,UJ,x)) , 

where wc used that u is ^-constant, that is, that Ps{u) ~ u. I 
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3.2 Characteristics 



Definition 3.6 Let (9, ip) be a RDSI, and suppose that /i G Sj/ (with corresponding random variable 
fi). An equilibrium associated to /2 (or to fi) is any equihbrium ^ of the RDS {9,Lp^). The set of all 
equilibria associated to /I is denoted as £{fj.). □ 

That is, an element ^ G S{p,) is a random variable fl ^ X such that 

(p(i,w,^(w),/i) =e(^tcj) e r^o, Vcj e O. (9) 

When we have an RDS (no inputs) , we write simply £ for the set of equilibria. 

For deterministic systems (il has one point), when the set £{fl) consists of a single element, the mapping 
jl 1— > £{p.) is the object called the "input to state characteristic" in the literature on monotone i/o 
systems. For systems with outputs, composition with the output map h provides the "input to output" 
characteristic. We extend this notion to RDSIs. 

Definition 3.7 An RDSI {9, ip) is said to have an input to state characteristic k : if 

ipu{t, 9^ti-^, 2;(aj)) — > ku{uj) as t ^ oo , for almost all a; G , 
for each ^-constant input u G S]l and any random initial state x G X^^^. 

Lemma 3.8 Suppose that ^ G £{ii) and define 

7? : r^o X 17 ^ r 

by 

77(t,a;) := h{(p{t,uj,£,{uj), fi),9tuj) . 

Then, rj is 0-constant. 



Proof. Using ([9|), we have that, for all t,s, 



= h{ip{t + s, 9^,Lo, e(6i_,cj), n),9t+s9-si^) 
= h{i{9t+s9.sio),9tLo) 

= h{^{9tL0),9tL0) 

= /i(V3(t,cj,f(a;),^),6'tCj) 
= ??(i,w), 

proving that Ps{r]) = rj for all s G T^Oi that is, t] is 0-constant. I 

Definition 3.9 Let {9,(p,h) be a RDSIO, and suppose that ^ G £{fi)- Then fj (or 77) as defined in 
Lemma l3.8l is an output equilibrium associated to fl (or fi). The set of all output equilibria associated to 
p. is denoted as /C(/i). □ 

Definition 3.10 [Uniformly Tempered] A sequence {bk)kG'M of random variables f2 — >■ X is said to be 
uniformly tempered in the metric space X if, for every 7 > and every w G fi, there exists a if ^ 
such that 

sup\bki9sio)\e-'^^'^ K , Vn G N . 
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Definition 3.11 [Continuity of the I/S Characteristic] Suppose an RDSI Lp: 7^o x J7 x X x — > X 
has an input to state characteristic : x [/g X. The map is said to be continuous if. for 
every uniformly tempered sequence (6fc)fegN in ?7g, the sequence {K-^ {■ ,hk))ke'(i is uniformly tempered 



We extend this definition to the composition with the output map as well (/C). Continuity will follow 
from a Lipschitz property and tempered assumption on h. Tools from ergodic theory as in [4] can be 
used to establish existence of characteristics, as well as continuity, for several classes of systems. 

A key result (see below) will be that, for monotone RDSI with continuous (in this sense) characteristics, 
the "CICS" (Converging Input/Converging State) property holds. This property is generally not true 
for (even deterministic) non-monotone systems. 



3.3 Discrete Time RDSIs 

Like before, when 7" = Z we refer to (/? as a random discrete dynamical system with inputs {and outputs), 
or discrete RDSI (RDSIO) for short. We now discuss how these are generated recursively by transition 
mappings. For each u Q U we will denote hy u € S^j the trivial 0-stochastic process defined by 

u{t, uj) := u , (t, uj) G 7^0 X fl . 

Let f: ilxXxU^Xhe defined by 

f{uj,x,u):=ip{l,uj,x,u), {uj,x,u) e ^ X X X U . (10) 

Then 

(p{l,uj,x,u) ~ f{u!,x,u{0,uj)) , {uj,x,u) e X X X Sg . (11) 
Indeed, it follows from pUj) that 



ip{l,u!,x,u{0,uj)) — f{uj,x,u{Q,uj)) , {ijj,x,u) <E X X X U . 
On the other hand it follows from (15) that 



93(1, CJ, It) = (^(1, w, cc, u(0, cj)) . 

This shows (ITT|). It then follows from (14) that 

tp{n + 1, w, X, u) = Lp{l, Onio, (fin, lo, x, u),pn{u)) 

= f{OnUJ,(p{n,uj,x,u), (p„(u))(0,6'„a;)) 
= f{9ni^-, ^{n, UJ, x, u), u{n, u)) . 

Therefore the dynamics ip is all encoded in /. Observe that 

J[-,-,u):nxX ^ X 

is measurable for each u G U, and that 

f{io,;u):X ^X 

is continuous for each {oj,u) G ft x U. 

Conversely, suppose f : ilx X xU X is such that /(■, ■, u) is measurable for each u G U, and f{uj, ■, u) 
is continuous for each (uj, u) G x U. Define ip : 7>o x il x X x X recursively by 

ip{0,uj,x,u) := X , {io,x,u) € X X X Sg , (12) 
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ip{l,uj,x,u) -.^ f{uj,x,u{0,Lu)) , {lu,x,u) e n X X X , (13) 

and 

(p{n + 1, X, u) := /(0„aj, (p{n^ a;, x, w), uin^ a;)) , (a;, x, u) G x X x , G N , (14) 
recursively. We claim that 1^9 is a discrete RDSI, that is, that it satisfies (I1)~(I5). 

(11) Fixed u G and A G B{X) arbitrarily we have 

CXD 

{^{■,;;u)y\A) = \J{n]x{^{nr,;u))-\A) 

Tl = 

= ({0}xl]x^)U I^Qmx (/(0„_i(.),¥>(n-l, •,-,«),"(" -l,-))"'(^)^ • 

It follows by induction on n that /(e'„_i(-),<p(n-l,-,-,u),w(n-l,-)) [A) (zF®B{X) for each n G N. 
Thus 

{ip{-,-,-,u)y\A) G r{n) xf®b{x) c v{n)®j'®B{x). 

(12) For t = or t = 1, this follows straight from (fT2 |) .(|13 |) together with the hypothesis that /(w, •, u) is 
continuous for each {lo^u) G x [/. For n ^ 2, it follows by induction on n by means of equation (jl4p . 
since f{9nUJ, (p{n, u!,-,u), u{n, w)) will be continuous whenever ip(n, uj,-,u) is. 

(13) This is just equation (|T2)> . 

(14) For each fixed w G fi, a; G X, u, w G 5^, and s G Z^o, we use induction on t G Z^o- For t = 0, (14) 
holds trivially in virtue of (15) (see below). Now suppose it holds for t = 0, 1, . . . , to- Define j/, z, w as in 
the statement of (15). Then 

ip{t(3 + l,esUJ,y,v) = f{6t„0sUJ,ip{ta,6sUJ,y,v),v{to,Os)) 

= f{St„+si^,v{to + s,ui,x,w),w{to +s,uj)) 
= (p{to + .s + 1, uj, X, w) . 

(15) This follows from induction on n G Z^o- Fix w G il, x G X and u G arbitrarily. Equations 
([T2|) and ([T3| give us the base of the induction. Now if u{t, uj) = v{t, uj) for t = 0, 1, . . . , t and we have 
already verified (15) when this happens for r = 0,l,...,t — 1, then ip(t, uj, x, u) = ip{t, uj, x, v) and so it 
follows from that 

ip{t + l,uj,x,u) = f{9tu;,ip{t,uj,x,u),u{t,uj)) 
= f{Sti^,'p{t,UJ,x,v),v{t,uj)) 
= ip{t + l,uj,x,v) . 



3.4 RDSI's Generated by Random Differential Equations with Inputs 

We now consider one of the prototypes for continuous time random dynamical systems with inputs 
(RDSI) from which we shall draw most of our nontrivial explicit examples, namely, RDSI's generated 
by random differential equations (with inputs). 

Definition 3.12 [Right-Hand Side] Let 9 = {fl, J^,F, {et)teR) be a continuous time MPDS, X be an 
open subset of M" , and U a metric space. A right-hand side (rhs) with respect to 9, X and [/ is a map 
f-.nxXxU-^m." 

Definition 3.13 [Solution of An RDEI] Let / : 17 x X x f/ ^ M" be an rhs with respect to 6*, X and 
U. Given an environmental condition w G fi, an initial condition xq G X and an input u: M^o — > f/, a 

solution of the random initial value problem 

( i = f{9tuj,x,u{t)) 
\ .t(0) = a;o 
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is an absolutely continuous map ^: [0,to) — > < to ^ oo, such that 

f f{e,uj,^{T),u{T))dT, O^t<to. (16) 



Such a solution is said to be maximal if [0, sq) C [0, to) whenever C : [0, sq) — >■ X is a solution. It is said 
to be unique if ^{t) = ((t) for all t 6 [0,to) H [0, sq), whenever C: [0, sq) — !• X is a solution. 

Definition 3.14 [Flow of An RDEI] Let /: 17 x X x J7 R" be an rhs with respect to 6*, X and U. 
Suppose that for each environmental condition w G il, each initial condition xq £ X , and each stochastic 
input u: R^o x £7 — > [/, there existes a unique, maximal solution 

^{iu,xo,u)- [O,to{^,xo,u)) — > X 

of ([15]) . The flow of f is defined by 

ip:V^ — > X 

where 

:= {{t, Lu, X, u) G R^o xnx X X ; 0^t< to{uj, x, u)} . 

Theorem 1 (Local RDS through RDE) Let f : fl x X ^ R" be measurable and consider the path- 
wise random differential equation 

x{t) = f{0tLU,xit)). (17) 

For each fixed oj £ fl, define /(^ : R x X — > R" by 

fu:{t,x) -.^ f{etOj,x) , (i,a;)GRxR". 
V fij £ LiocO^jC^'^) for all uj G Q., then |j7| ) uniquely generates a continuous RDS if over 9. 

Proposition 3.15 Consider the hypothesis and notation in Definition \3.14\ Then 1^9 is a local random 
dynamical system with inputs. 

Proof. Parts (II) and (12) follow from the regularity hypotheses together with the measurability of the 
limit of measurable maps as well as continuity with respect to initial conditions. 



(13) This follows straight from (|T6| . 

(14) We first do the computations for the case in which to{Lu, x,u) =00 for all (w, x,u) £ il x X x U; 
that is, = R^o x fl x X x Sg. Fix s,t £ R^o, w G 17, x G X and u,v G 5^ arbitrarily. Let 
y := f{s, UJ, X, u); we want to show that 

ip{t, 9sL0, y, v) = ip{s + t, UJ, X, w) , 

where w : R^o x — > [/ is defined by 



w{t, Lo) 



u{t, io) , ^ T < s 
v{t~s,9sUj), s^t 
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We have 



(f{t,esUj,y,v) = y+ f{0s+ri^,(p{T,esUJ,y,v),v{T,esUj))dT 



ip{s,UJ,X,u) + / f{6s+TUJ,(p{T,0sUJ,y,v),v{T,0sUj))dT 



x+ f{9aUJ,f{cr,uj,x,u),u{a,uj))da 







+ / fiOs+T^^,viT,esUj,y,v),v{T,esUj))dT 



x+ f{9aUj,ip{a,uj,x,u),u{a,uj))da 



hence 



where 



+ / fiSp^^, fip - s, OsU}, y, u), v{p - s, 9sUj)) dp , 

J s 

rs+t 

lf{t,0sUJ,y,v) = X + f{9T,L0,ll){TT,L0,X,w),w{TT,Uj))d'K , (18) 

"'0 

, ^(-'-'-'-)' 0J-<^ . (19) 



Now notice that, m particular, 

ip{'!r,u!, x,w) = (p{Tr,uj,x,u) 



/•TT 

X+ f{9T^,'P{T,UJ,X,u),u{T,Uj))dT 

Jo 



= X+ f{9T-LJ,%l){T,UJ,X,w),w{T,Uj))dT, 

Jo 

for ^ TT < s. And since t ^ was chosen arbitraryly, it follows from ([T8|) and (fT9|) that 

r 

■(/'(tT, W, X, w) = a; + j f{9rUJ,llj{T,UJ,X,w),w{T,Uj))dT, TT ^ s . 

Therefore indeed 

^{Tr,U},X,w) = X + I f{9rU!,^{T,UJ,X,w),w{T,Uj))dT, TT ^ . 







But 

r 

(p{'K,UJ, X,w) = X + / f{9rUJ,(p{T,UJ,X,'w),w{T,Uj))dT, TT ^ , 
^0 

also. Therefore it follows by uniqueness that 

(p{s + t, uj, X, w) — ip{s + t, uj, X, w) — (p{t, 9sU!, y, v) . 

(15) Finally, given t^O^co&il, x&X and u,v ^ Sg such that w(r, w) = v{t, w) for almost all r £ [0, t), 
we then have 



f{s,(jj,x,u) = x+ f{9rU},ip{T,U;,X,u),u{T,Uj))dT 







= X+ f{9rLL!,ip{T,L0,X,u),v{T,Uj))dT, O^S<t. 

Jo 

It then follows by the assumption of uniqueness (see Definition 13. 13p that (p(t, uj, x, u) — (pit, uj, x, v). 
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4 Feedback Interconnections 



In this section wc define the feedbaek intereonneetion of two RDSIOs. We want to consider, given 
systems (0, Lp, h) and (0, (p, h), an RDS in which the output of the first system is the input to the second 
one, and viceversa. So througout the remaining of this section we will refer to two RDSIOs {9, Lp, h) and 
{9,ip,h) over the same measure preserving dynamical system 6 ~ (fl, J-'jF, {9t}teT) a-nd with cocycles 
and outputs 

ip -.7+ xQx X X — > X , 

h-.rix X — > V , 

ip ■.T+ xflx Z X — > Z , 

h-.rix z — > u . 

4.1 Discrete Systems 

Before we lay down the general abstract framework we consider the feedback interconnection of two 
discrete systems, that is, T = Z. As we saw in Subsection 13.31 the dynamics of (p and (p can be encoded 
in their generators f : fl x X x U ^ X and f : fl x Z xV ^ Z. Now let 

F:nx{XxZ) ^ (XxZ)^ ^ 

{uj,{x,z)) I — > {f{uj,x,h{uj,z))J{uj,z,h{uj,x))). 

Let <i> -.nx {X X Z) ^ {X X Z) be the RDS generated by F: 

$(0,a;, (x, z)) := (a;, z) , (w, (x, z)) £ fl x {X x Z) , 

$(1, w, [x, z)) := Fiuj, (x, z)) , (w, {x, z))enxiXxZ), 

and 

$(n + l,a;,(.T,z)) :=F(6'„cj,$(n,a;,(a;,z))), {u, (x, z)) € n x {X x Z) , neN, 

recursively. Given initial states x £ X and z G Z, define /i = fix.z G "S*^ and i/ = v^.z G also 
recursively by 

0) := (^(0, cj, a;, vf) ~ h{uj, x) , 
v{uj, 0) := (p{0, Lu, z, /i)) = h{u!, z) ; 
^(w, n) := h{9nU}, (p{n, uj, x, v)) , 
^{uj^n) := h{9nU}, (p>{n,uj, z, fj.)) , 7i G N . 
We are, of course, abusing notation a little bit here. The point is that because of causality and inde- 
pendence of irrelevant random states ((14) and (15)) we need only know '^||^}.x[on) ~ ^1 {lj}x [o n-i] 
compute iy9(n, w, X, I'). Similarly, we need only know /i| ^^j^^ ~ ^^\{LJ}x[o n-i] to compute (p(n, oj, a;, /x), 
and so the induction is well established. The 6'-stochastic processes ^ and v so defined are then the 
unique ^-stochastic processes satisfying the system of equations 

= h{9nLU,ip{n,io, z, fj,)) 
n(uj,n) = h{9nLu,ip{n,uj,x,iy)) . 

4.2 Random Differential Equations 

A similar discussion shows that for systems generated by differential equations with noise, the feedback 
connection is obtained as the RDS generated by 
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4.3 Abstract Systems 

For abstract systems, there is most probably no way to provide a general definition of interconnection. 
(Similar difficulties arise in control theory, even when studying deterministic systems.) Thus, we proceed 
axiomatically. 

Definition 4.1 We say that the feedback {interconnection) of the RDSIO's {9,(p,h) and {9,(p,h) is 
well-posed provided that, for each x €z X and each z £ Z , 

(1) there exist = fJ.x,z ^ and v ^ v^^z G 5^ such that 

v{t,uj) ~ h{6tLu,ip{t,uj,x, fi)), 
fi{t,LL!) ~ h{6tuj,ip{t,uj, z,iy)), 

for all t S 7^0 and all w G f2; 

(2) if ^' e 5^, zy' e are such that 

v'{t,uj) = h{9tLu,ip{t,uj,x, ^')), 
^'{t,uj) = h{6tLu, ip{t,uj, z,v')), 

then fi'(-,LL!) ~ /i(-,a;) and u'^-^lo) — J^(-,a;) almost surely, for each a; 6 51. 

That is, fJ.x,z,i^x,z must exist, and be unique in a certain sense for the feedback interconnection to be 
well-posed. □ 

Lemma 4.2 Suppose that the feedback interconnection of [9, ip, h) and {9, if, h) is well-posed. Then 

ip{t,uj,{x,z)) {ip{t,uj,x,^ix,z),'p{t,uj,z,Vx,z)) , {t,uj,{x,z)) eT^o xn X {X X Z) , 
satisfies the cocyle property and {9, -tji) is an RDS with state space the Cartesian product X x Z . 

4.4 Equilibria of feedback systems 

Lemma 4.3 Suppose that the feedback interconnection of {9i,ipi,hi) and (6'2, </?2, is well-posed. 
Then, the following two properties are equivalent: 

1. for the feedback system, (^, Q S £; 

2. there exists a pair of ^-constant inputs ji and u such that 

/ie/C(i?), i>e/C(M), ee^(M)), Ce^(i^))- 
5 Monotone and ant i- monotone RDIOS 

If (Qi !i) is an ordered space and p,q G , we write "p < g" to mean that p{t,u!) < q{t,uj) for all 
t G 7^0 and all a; G il. 

Definition 5.1 A RDSI (6*, is monotone if U,X are ordered spaces and 

X < z and u<v => ^^.u < ^z.v 

for x,z £ X and u,v G S}l . An RDSIO {9,(p,h) is monotone if, in addition, Y is an ordered space 
and h is order-preserving: h{uj, x) < hiuj, z) whenever x < z and anti-monotone if h reverses order: 
h(uj,x) < h{u),z) whenever x>z. □ 
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For the results sketched below, we restrict attention to ordered spaces induced by cones in Banach spaces 
as in [51 121 . 

Observe that a system is anti-monotone system if and only if 

X > z a.nd u < V => rix.ul^Vz^v ^ x, z £ X, u,v Sg' , (21) 

Sufficiency is clear, since hiuj^x) = rix,uiO,uj) < 77z.u(0,aj) — h{u!,x), and the converse follows from 
r]x,u{t,uj) = h{0tUJ,^x,u{t,uj)) < h{9tLV,^z,v{.t,uj)) = r]^^^{t,uj). 

An important fact is as follows. 

Theorem 2 (Converging Input/Converging State) Let ip be a monotone RDSI with a continuous 
I/S characteristc . Suppose that u G and u G are such that 

u{t, O^tLo) — > u{uj) , as t ^ oo , \/lu G 57 . 

Then for any random initial state x G , then almost all pull-back trajectories of (f subject to u and 
starting at x converge to K-^ {■,€,): 

(p{t, x{9-tijj), u) — > K'^ {u}, u) , as t ^ oo , Vw G 51 . 
5.1 Small-gain theorem: discussion 

A small-gain theorem for anti-monotone systems follows by the same steps as in the deterministic case 
([I1I3)- The key idea is to assume that characteristics are continuous in our tempered sense and that 
a small gain condition is satisfied. The main theorem will be for an anti-monotone RDSIO so that 
iterations of characteristics converge to a unique equilibrium, which amounts (subject to mild technical 
conditions on cones and the space X) to the requirement that /C has no period two points except for a 
unique equilibrium, in the sense that there exists some /io so that 

fL £ K.{K.{fi)) =► fi^flo- 

We assume, further, that the feedback connection of this system with itself is well-posed and monotone. 
Then (almost) every solution of the closed- loop system converges to £{jl). A proof as in [H [7| begins 
by appealing to the CICS (Converging Input /Converging State) property for monotone RDSIO's, and 
establishes a contraction property on the "limsup" and "liminf" (defined as in these references) of 
external signals. An alternative approach is based on the idea in [5], in which one first proves that the 
feedback of two monotone or two anti- monotone systems is monotone. More precisely, if {9i, tpi,hi) and 
{62, (p2, /12) are both anti-monotone RDSIO's, we consider the following order in Xi x X2: 

(x, z) < (xjz) iff X <x and z < z 

(that is, the order on the second component is reversed). If, instead, {0i, ipi, hi) and (02,¥'2,^2) are 
both monotone RDSIO's, we consider the product order in Xi x X2: 

{x, z) < (Xjz) iff X < X and z <z . 

One then shows that the feedback system is monotone, and the small-gain condition assures that there 
is a unique equilibrium (a.e.) for the composite system, allowing one to appeal to the theorem in [3]. 

A Measurability Issues 

Though interesting, important, and often nontrivial, measurability issues are often a distraction from the 
main ideas when one is talking about random dynamical systems. We therefore collect all technicalities 
concerning measurability into this appendix. 

The following Lemma is a standard result from real analysis which is not very often presented in such 
generality. So we briefly digress into proving it. 
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Lemma A.l Let {X,d) be a metric space, {^,J-) a measurable space, and (/„)„gN a sequence of 
measurable maps O — s- X. li fn ^ f almost everywhere, then / is also measurable. 

Proof. By redefining /, /„, n ~ 1, 2, 3, . . . on the set of measure zero where convergence does not happen, 
if necessary, we may assume without loss of generality that convergence occurs everywhere. Let [/ C X 
be any open set and A C X he any closed set. For every lu G f~^{U), we have /„(cj) S U for all rz G N 
large enough, due to the pointwise convergence. Hence 

oo 

r\u) c y /-!([/) 

n—m 

for all ni G N, and so 



oo oo 



r\u)c fi y f-\u). (22) 

m— 1 n— rn 

It is also true that 

oo oo 

n y f-\A)cr\A). (23) 

m— 1 n—m 

Indeed, if uj is in the set defined by the lefthand side, then there is a subsequence (nj)jgN along which 
fuji'^) G A for all j G N. Since fn{^) f{^) as n ^> oo and A is closed, it follows that f{io) £ A also; 
that is, LU G 

Now fix an open set V C X arbitraliy. For each fc G N, define 

Ak := {x- G X ; dist(a;, V") ^ 1/fc} 

and 

C/fc := {x G X ; dist(x-, V) > 1/fc}, . 
Then the A^s are closed, the UkS are open, [7^ C Ak, fc G N, and 

oo oo 

y = y = y c/fe . 

oo 

f-Hv) = \Jr\Ak) 

oo oo oo 

3 u n u fn\Ak) 

k—1 m—l n— rn 

oo oo oo 

3 u n u/"^(t^^)- 



Now from we have 



fc^l m— 1 n—m 



On the other hand 



oo oo oo 



r'(^) = U /"'(t^^) ^ U n U /» '(t^^) 

fc— 1 k—1 m—l n—m 

by (P^ . The two inclusions combined yield 



oo oo oo 



r'(^) = U n U fn'meT, 



k—1 m — l n—m 

completing the proof. I 

The following proposition is a standard fact from product measures, but we nevertheless state it here to 
emphasize its for all scope. 
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Proposition A. 2 Let (X, J^), {Y,Q), {Z,T-L) be measurable spaces. 
(a) HE eF®g, then 

£^1. := {y e r ; (x,y) e e 5, for all x^X, 

and likewise 

Ey --{xeX- (x, y) e £;} e J" , for all j/ £ F . 

("ft^ If / : X X F ^ Z is an J^CgjtJ-measurable map, then the projection maps f^'-Y^Z and : X — > Z, 
defined by 

/.(2/):=/(a:,2/)=:/na^), (a-, £ X x F , 
are ^/-measurable and J-'-measurable, respectively, for all x ^ X and all y . 

Proof. Sec Proposition 2.34, page 65]. I 

Proposition A. 3 Let {T,F) be a measurable space, X a separable topological space, also thought of 
as a measurable space with its Borel cr-algebra, and / : T x X — s- R a measurable function such that 
f{t, •) : X ^> M is continuous for each t ^T. Then the fimction F: T — ^ M defined by 

:= sup /(<, x) , teT, 
xex 

is also measurable. 

Proof. Let {xk)keK be a dense sequence in X. By Proposition lA. 21 the functions f{-,Xk)- T — > R are 
measurable for each fc 6 N. Therefore it is enough to show that 

F{t)^ sup fit,Xk), WteT. (24) 

fcGN 

Fix t £ T arbitrarily and let (?/„)„gN be a sequence in X such that 

F{t) = lim /(t, y„) . 

For each n G N, pick fc„ G N such that 

\fit,XkJ - f{t,yn)\ < l/n, 
which is possible since f{t, •) is continuous and {xk)ki£N is dense in X. Then 

lim f{t,XkJ = lim f{t,y„)^F{t). 

n—^ao n— J-oo 

Since f{t,x) < F{t) for every x & X, this proves ([24]). I 



B Spaces of Functions in 

Definition B.l [C''^^] Given fc G Z^^o and (5 < 1, we define C'^'^ to be the Frechet space of functions 
/ : R'' R"* which are k times continuously differentiable and, for S > 0, whose fc-th derivative is locally 
(5-H61der continuous — Lipschitz continuous for S = 1 — ; that is, for every compact subset K C R'', 

\D^f{x)-D^fiy)\ 



sup - — — , t " ' < oo . 
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For each such K we also define the norms 11 • ||fc.o:X, || • llfc.S K : C^'^ 



\\f\\k,0;K:^ V sup|i?"/(x)| 

and 



llfll ■ llfll + \DV{x)-D-fiy)\ , 

\\j\\k,S-K \\j\\k,0;K + 2^ sup 1 _ , J eC . 

\^\_i.x,v<^K F y\ 

Definition B.2 [Lioc{M.,C'''^)] Given fc e Z5.0 and < (5 < 1, we define Lioc{M.,C''-^) to be the set of 
measurable functions / : M x M'' ^> M'' such that 

(i) f{t, •) e C"'^ for almost every t £ R; 

(ii) for every compact set K C M'' and every bounded interval [a, b] C M, 

a 

Remark B.3 The fact that 



is measurable is not obvious. Suppose (i) in Definition IB.2I holds. Redefining f{t, •) = for those values 
of t G [a, for which (i) may not hold, if necessary, we may assume (?) holds for all t G [a, 6]. Observe 
that a compact set K C M."^ constitutes a separable space (any subset of M'* does). Also, for each 
^ |a| ^ k, is measurable and \D°'{t, ■)\ is continuous. So it follows from Proposition lA. 31 that 

snp\D'^fix)\, te[a,b], 

is measurable. Therefore 

t^\\fit,-)\\k.O;K, te[a,b], 

is measurable. Similarly, then 

C (A' X A:)\{(a;, y) e K x K ; x ^ y} . 

is also separable. So, for \a\ — fc, 

a i \D^f{t,x)^D'-f{t,y)\ c r M ^ 

i, (a;,y 1 — > ■ , x, y)) G a, 6 x C , 

\x - y\° 



is measurable, and 

\D^f{t ,x)-D '-f{t,y) 

\x - y\ 

is continuous for each t G [a, 6]. It follows again from Proposition IA.3I that 



1 1 — > sup . , t€[a,b\, 

is measurable, so that 

t^\\I{t.-)\\k^s,K. ie[a,6], 
is also measurable. □ 
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